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Title: TRAINING, INFERENCE AND USER INTERFACE FOR GUIDING THE 
CACHING OF MEDIA CONTENT ON LOCAL STORES 



Tpc hnical Field 

5 The present invention relates to information retrieval and processing, and more 

particularly to a system and method for storing selected information in a local storage 
system as a function of a user's previous reviewing habits over different time intervals. 



Baf kgroiind of thf Inventiftn 

1 0 Recently, there has been an increasing trend of the amount of information 

available on any given subject matter due to the interconnection of computer via networks 
(e.g., the bitemet) and the increased availability of inexpensive data storage. Li many 
situations people attempting to retrieve information on a subject area are overwhelmed 
with a vast amount of information. Data that is desired becomes difficult to locate 

1 5 amongst the vast amount of information presented to a user. Various known information 

retrieval systems have evolved that attempt to avoid the problem of information overload 
by performing a ranking or prioritization of information. These systems attempt to 
retrieve and provide information based on an approximation of how useful, interesting, 
and/or responsive the information is likely to be to a system user. 

20 For example, many systems provide search engines, which search database 

contents or "web sites" according to terms provided by a user query. However, 
limitations of search heuristics often cause irrelevant content to be returned in response to 
a query. Furthermore, the vast wealth of available information makes it difficult to 
separate irrelevant content from relevant content. Other systems organize content based 

25 on a hierarchy of categories. These systems suffer from the fact a user may select a 

category to navigate through and determine that the content of the category is of no 
interest to the user. The user must then backtrack through one or more of the hierarchical 
categories to return to the available categories. The user will have to continue this 
process until the user locates the desired information. 
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In view of the shortcomings of the systems discussed above, probabilistic 
predictive models have been developed. Collaborative filtering systems are one particular 
type of predictive probabilistic predictive model. Collaborative filtering systems predict 
preferences of a user based on known attributes of the user, as well as known attributes of 
5 other users. For example, a preference of a user may be whether they would like to watch 

a particular television show, while an attribute of the user may include their age, gender 
and income. In addition, the attributes can contain one or more of the user's known 
preferences, such as the user's dislikes of certain other shows. A user's preference can 
also be predicted based on the similarity of that user's attributes to other users. Typically, 
10 attributes are provided numerical values (e.g., a vote) and a weighted sum of the attribute 
values are utilized to determine a preference. Additionally, correlation computations are 
employed for a given user and other users to predict the preference of a user for a 
particular selection. Some collaborative filtering systems employ clustering algorithms to 
determine users whose preferences seem to be similar. 

1 5 Collaborative filtering systems have been determined to be relatively successful in 

selecting desirable preferences of a user given adequate attributes of the user. However, 
in certain circumstances a single system may be employed that is utilized by multiple 
users all having different attributes and preferences. For example, a single household 
may all share a single computer or a single television device. In these circumstance, there 

20 is no way for a collaborative filtering system to determine which of the household 

members is utilizing the system at any given time without the member identifying 
themselves. 

In today's world of complex media offerings and time-shifted viewing of 
streamed content, potentially at lower than real-time rates fi'om sources such as satellites 
25 there is an unmet need for assisting users in caching content onto local stores that they are 

most interested in reviewing. For example, some services offer users upwards of 500 
programs to select amongst. Such offerings also provide a large hard disc for local 
caching of content. However, even these large hard discs have a limited amount of 
storage for caching content locally. 
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Accordingly, there is an unmet need in the art for providing probabilistic 
predictive techniques to an information retrieval system and a local storage system that 
can be employed on a shared device. 



5 Summary of the Invention 

The present invention is related to a system and method of caching data guided by 
a probabilistic predictive model, such as collaborative filtering models and other 
statistical models that can be used to infer the likelihood of a user's preferences for 
content. The system and method have particular application to multimedia systems for 

10 providing storage of a subset of available viewing selections by assigning a value or 

utility to a selection and retaining selections in the cache depending on the value and size 
of a selection. An initial value of an item can be based on the user's viewing habits, the 
user's viewing habit over particular time segment (e.g., early morning, late morning, early 
afternoon, late afternoon, primetime, late night) and/or viewing habits of a group of user's 

1 5 during a particular time segment. 

A value assigned to a selection dynamically changes according to a set of cache 
retention policies. For example, a selection's value may be reduced as the selection ages 
because a user is less likely to view the selection over time. Additionally, the value of a 
selection may change based on changes on a user's viewing habits, changes in time 

20 segments or a user's modification of the predefined rules or policies. Such policies can 

be sensitive to the class of content cached. For example, the value of news broadcasts 
may decay more quickly with the age of the content, in comparison to documentary 
material covering a topic area that a user has conveyed an interest, hi one aspect of the 
invention, a utility-directed knapsack analysis is continuously performed to store newly 

25 available content into available memory, based on the consideration of the "expected 

value density" of the content, which is defined as the ratio of the value assigned to some 
media content and the memory cost of storing the content based on the size of the content. 

Another aspect of the invention relates to the situation where all available memory 
30 becomes totally committed, hi this event, newly available content overwrites previously 
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stored content when the expected value density of the new content exceeds the expected 
value density of older content. The expected utility of maintaining content in memory 
can be determined by the ratio of the current utility as a function of the age of the item, 
based on the policy that is active for the particular item. The value of content stored in 
5 cache decays based on the class or type of content, in accordance with a time-dependent 

utility model, for example, utility becomes a function of initial utility, age and content 
class. Thus, the expected value density of content stored in memory is the ratio of the 
size of the object and the current utility of the object as determined by the time-dependent 
utility model. 

10 In one aspect of the invention, the initial value of content is the probability that 

the user will review the content and the change in the likelihood that the user will review 
content with the time that it has been stored in memory without review. Such a 
probability can be taken as indicated by a score provided by an inferential model of a 
user's preference, such as the score assigned by a collaborative filtering model. The 

1 5 collaborative filtering model can be enhanced with popularity filtering. In another 

approach, a time-centric collaborative filtering model can be employed. 

Another aspect of the invention relates to providing a separate storage area and 
policies for selections that are cached for use approximately in real time. For example, 
the invention solves the problem of the^situation where a user has missed the 

20 commencement of a broadcast because of tardiness based on transportation or meeting 

delays. In such a situation, a broadcast television show is already in progress when the 
user comes available in an appropriate place to review the television content. The present 
invention provides for the storage of N number of selections based on predictions of 
selections a viewer is most likely going to watch at any given moment and begins 

25 recording those shows into a cache at the beginning of the program. In the event that the 

viewer turns on a selection of one of the N selections of interest, the remaining non- 
selected selections are removed from the separate storage area. In the event that none of 
the selections are selected, the selections age quickly and are removed from the separate 
storage area so that new selections in a new time period may be stored. Alternatively, the 

30 selections may be stored in the general storage area with a value decay that is quicker than 

other selections based on the nature of the content and/or the associated value assigned to 
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the content. 

Another aspect of the invention relates to a system and method for storing 
portions of data of selections in cache if the selections have data viewing rates that are 
faster than the rate the data can be received from a source that makes the content available 
5 on demand. Once a selection is made and viewing begins, the amount of data in the 

cache is always maintained such that viewing is not interrupted, hi such cases, 
speculative recording of television content based on expected value density can store 
content at lower cost, as the complete content does not have to be stored. Rather an 
amount of content that ideally buffers the content for real-time viewing can be stored. 

1 0 Such buffering of content effectively raises the value density of content that can be 

accessed as the ratio of value to cost is greater. 

To the accomplishment of the foregoing and related ends, the invention then, 
comprises the features hereinafter described and particularly pointed out in the claims. 
The following description and the annexed drawings set forth in detail certain illustrative 

15 aspects of the invention. These aspects are indicative, however, of but a few of the 

various ways in which the principles of the invention may be employed and the present 
invention is intended to include all such aspects and their equivalents. Other objects, 
advantages and novel features of the invention will become apparent from the following 
detailed description of the invention when considered in conjunction with the drawings. 

20 

Brief Description of the Drawings 

Fig. 1 illustrates a block diagram of a system utilizing an inference system in 
accordance with one aspect of the present invention. 

Fig. 2 illustrates a block diagram of an inference system being employed in a 
25 multimedia system in accordance with one aspect of the present invention. 

Fig. 3 illustrates a block diagram of a local storage system in accordance with one 
aspect of the present invention. 

Fig. 4 illustrates a block diagram of a local storage system in accordance with 
another aspect of the present invention. 
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Fig. 5 illustrates a block diagram of an inference system being employed in a 
program delivery system including a memory storage system for recording live shows in 
accordance with one aspect of the present invention. 

Fig. 6 illustrates a block diagram of a possible user interface of an electronic 
5 program guide in accordance with one aspect of the present invention. 

Fig. 7 illustrates a block diagram of a program delivery system residing on a 
server coupled to a set top box having secondary storage system in accordance with one 
aspect of the present invention. 

Fig. 8 illustrates a block diagram of a secondary memory system for providing real 
1 0 time viewing of non-live shows in accordance with one aspect of the present invention. 

Fig. 9 illustrates a flow diagram of a methodology for providing ranked 
recommendations of titles of information to a memory loading system in accordance with 
one aspect of the invention. 

Fig. 10 illustrates a flow diagram of a methodology for storing program 
1 5 information in a local storage system in accordance with one aspect of the invention. 

Fig. 1 1 illustrates a flow diagram for providing real time viewing of non-live 
shows in accordance with one aspect of the invention. 

Fig. 12 illustrates a block diagram of a computer system in accordance with an 
environment of the present invention. 

20 

npitailed DpscHption of the Tnvenrinn 

The present invention is related to a system and method of caching data guided by 
a probabilistic predictive model, such as collaborative filtering models and other 
statistical models that can be used to infer the likelihood of a user's preferences for, 

25 content. The system and method have particular application to multimedia systems for 

providing storage of a subset of available viewing selections by assigning a value or 
utility to a selection and retaining selections in the cache depending on the value and size 
of a selection. An initial value of an item can be based on the user's viewing habits, the 
user's viewing habit over particular time segment (e.g., early morning, late morning, early 

30 afternoon, late afternoon, primetime, late night) and/or viewing habits of a group of user's 

during a particular time segment. 

6 
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The present invention has particularly useful application to multimedia systems 
where viewing content is time shifted at lower than real-time rates from media delivery 
systems (e.g., satellite systems). The present invention provides a system and method for 
determining reconmiendations of media selections of system users most likely to be 
5 watched by a system user and employing these recommendations to store {e.g., cache) 

information locally corresponding to the recommendations. The storing of the 
information is determined by inferences, by employing probabilistic predictive models, 
such as collaborative filtering techniques, based on the time interval or time segment of 
previously viewed selections. The probabilistic predictive techniques of the present 

10 invention allow for the system to predict the likelihood that a user will prefer a program 
regardless of the user's genre by evaluating the time interval of previously viewed 
information for a corresponding system. 

Fig. 1 illustrates an example of a system 10 utilizing an inference system 18 
employing probabilistic predictive model techniques, such as collaborative filtering 

1 5 techniques or other statistical model techniques that can be used to infer the likelihood of 

a user's preferences for content. The inference system 18 infers preferences of user's of 
the system and provides values to items for caching in a local storage system 27. In the 
present example, the inference system 18 ranks items or selections based on viewing 
habits of users of the system 10 in addition to considering time segments or intervals of 

20 those viewing habits. It is to be appreciated that various inference techniques may be 

employed to carry out the present invention (e.g., correlation techniques, Bayesian 
machine learning, statistical decision trees, etc.). In a training mode, the inference system 
1 8 utilizes selections of previously viewed information that is logged in a user's database 
12 and selections of previously viewed information that is logged in databases 16 of other 

25 shared systems. It is to be appreciated that the database information may be stored locally 

at the system 10, remotely at a remote server or the like (e.g., in a single database) or 
across a number of servers. Additionally, the inference system 1 8 may reside locally at 
the system 10, remotely at a remote server or across a number of servers. The inference 
system 1 8 is trained by examining selections reviewed by a large pool of users for more 

30 than a threshold amount of time. Negative votes are also considered by monitoring 

selections jumped away from after being reviewed briefly. Temporal filtering can then be 



MS 150903.1 



employed to provide a reviewed item list and a recommendation list for a particular time 
segment. 

Title selections are time stamped with different time segments by event type (e.g., 
title) and class type (e.g., news, documentary, sports events, etc.). The log data is 

5 annotated with distinctions about the time of the day that a system user has viewed the 

information. For example, a day can be segmented into early morning, mid-morning, 
afternoon, late afternoon, early evening, evening, late night. Additional segments can 
include information that is viewed on weekdays verse weekends. Furthermore, non- 
weekdays can be fiirther subdivided into Saturday, Sunday and holidays. Elements fi'om 

0 a dataset are considered tagged with these time segments or intervals and trained with this 

data employing conventional collaborative filtering techniques. Various probabilistic 
predictive model techniques may be employed to carry out the present invention (e.g., 
correlation techniques, Bayesian machine learning, probability tree networks, etc.). 

In real-time, appropriate information or evidence about a user's preferences is 

5 inputted into the inference system 18. Evidences of preferences include information fi'om 

previously selected information fi-om the database 12, other attributes of the shared 
system 14 and explicit input of samples of preferred items by the user through a user 
interface 22. Evidence of the users preference is largely gathered by implicit evidence of 
items that are liked or disliked by monitoring the user's activity. A positive vote is given 

0 to an item that the user dwells over for a threshold period of time, while negative votes 

are given to items that are briefly reviewed and jumped away fi-om for review of other 
content. Furthermore, a user via the user interface 22 may select an item for a positive or 
negative vote. For example, in a first iteration a user may be presented with a list of 
reviewed items for a selected time period. A user may then select amongst a variety of 

5 filtering components residing in a filtering system 20. Additionally, the user may select 

or provide positive or negative votes for items. The modified or filtered reviewed item 
list may then be inputted into the inference system 18 as fiirther evidence of user 
preferences. 

The inference system 18 can then provide a recommendation list of items ranked 
0 by preference values to the local storage system 27. The local storage system 27 then 

stores or records items that have the highest values. Items can be assigned higher values 

8 
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based on the likelihood that a user would like to view that item. Furthermore, values of 
items can be aged out based on a cache retention policy. Such policies can be sensitive to 
the class of content cached. For example, the value of news broadcasts may decay more 
quickly with the age of the content, in comparison to documentary material covering a 
5 topic area that a user has conveyed an interest. In one aspect of the invention, a utility- 

directed knapsack analysis is continuously performed to store newly available content 
into available memory, based on the consideration of the "expected value density" of the 
content, which is defined as the ratio of the value assigned to some media content and the 
memory cost of storing the content based on the size of the content. 

10 The inference system 1 8 ranks selections based on viewing habits of users of the 

system 1 0 in addition to being able to consider time segments or intervals of those 
viewing habits. The inference system 18 considers the temporal history of the content 
viewed by users of the system (e.g., a multi-user system) and dates the list of available 
information 28 (e.g., available media) that will be made available by an information 

1 5 delivery system 26. The inference system 1 8 scores active user events for every title 

stored in the database 12. The inference system 18 then provides a reviewed items list 
and a ranked recommendation list based on a requested time period to the user interface 
22 via the filtering system 20. The ranked recommendation list contains 
recommendations of selectable titles within the time period requested from a particular 

20 time segment via the user interface 22. The inference system 1 8 provides the ranked set 

of titles that may be of interest to a system user based on similar titles that the users of the 
system have historically viewed in that time segment. The filtering system 20 includes 
various filters for adding, deleting or modifying the reviewed items list (e.g., assigning 
positive or negative votes to items) and inputting the new evidence of preferences into the 

25 inference system 1 8 for updating of the reviewed items list and the ranked selectable 

information list. For example, a popularity filter may be employed to provide shows of 
interest that users of the system are not likely to know about. Furthermore, text 
descriptions of items may be added to the reviewed item list employing a search engine or 
the like. The new preferences may be inputted into the inference system 1 8 and a new 

30 recommendation list generated. 

Once a selection of a tide to view is made by a user via the user interface 22, a 

9 
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request is transmitted to the information delivery system 26, which transmits the 
requested information corresponding to the selected title to a viewer 24. The viewed 
information can be transmitted from the local storage system 27 (e.g., a local hard drive) 
or directly from the remote information system 25. Alternatively, a portion of the 
information can be stored in the local storage system 27 and transmitted to the viewer 24, 
while the remaining information is transmitted to the local storage system 27 from the 
remote information system 25, until the entire contents of the selected information has 
been viewed. 

The viewed information is then transmitted back to the previously viewed 
information database 12 for logging and for providing the viewed title and time segment 
information to the inference system 1 8 for fiirther training of the inference system 1 8. 
This ensures that the inference system 18 is continuously and automatically being updated 
with the latest viewing information. A system user may also select information to be 
recorded via the user interface 22 to the local storage system 27, which is then recorded 
for later viewing, or for viewing when data is viewed at a faster rate than it can be 
transmitted from the remote information system 25. 

Although, the inference system 1 8 is described with respect to a single 
probabilistic model, a plurality of time interval models can be trained and employed 
utilizing selections of previously viewed information over a respective time interval. 
Furthermore, the inference system 1 8 can employ a single probabilistic model in which 
previously viewed information is provided with a time stamp according to event 
occurrence for each time interval or segment, hi other words, a title being selected within 
two different time intervals is treated as different event occurrences, such that training is 
performed as if the event occurrence has occurred with a totally different title. 

It is to be appreciated that the present invention is particularly suited for providing 
selected titles of television programs or other multimedia to be stored locally in a local 
cache of a set top box or the like, hi this type of application, multiple members or users 
in a family utilizing a single television system make it improbable to determine 
preferences for any particular member of the family. Therefore, the present system and 
method are ideally suited for this application because household viewing habits are 
typically consistent at different times of a day for weekdays, weekends and holidays. For 
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example, children may watch children shows early Saturday mornings, while adults may 
watch different types of shows at different time periods, for example, soap operas at mid- 
aftemoon, sports on weekends, news at night and more adult oriented shows late at night. 
The probabilistic prediction models of the present invention apply time segmenting to a 
5 local caching system for determining probable program selections based on the temporal 

history of media viewing habits in a household. 

Fig. 2 illustrates an example of multimedia system 30 utilizing an inference 
system 38 employing probability predictive model techniques, such as time based 
collaborative filtering techniques. The inference system 38 ranks selections based on 

10 viewing habits of users of the system 30 in addition to considering time segments or 

intervals of those viewing habits. Various probabilistic predictive model techniques may 
be employed to carry out the present invention with respect to an application of a 
multimedia system. The inference system 38 receives titles of previous viewed programs 
that are logged in a database 32. Each title is time stamped with different time segments 

1 5 and the percentage of the complete program that the user has watched is logged in the 

database 32. The log data is annotated with distinctions about the time of the day that a 
system user has watched the television program. 

As previously mentioned, a day can be segmented into early morning, mid- 
moming, afternoon, late afternoon, early evening, evening, late night. Additional 

20 segments can include information that is viewed on weekdays verse weekends. 

Furthermore, non-weekdays can be further subdivided into Saturday, Sunday and 
holidays. Elements from a dataset are considered tagged with these time segments or 
intervals and trained with this data. The inference system 38 considers the temporal 
history of the programs viewed by users of the system (e.g., family members of a 

25 household) and dates and times of electronic program guide data 48 of available programs 

that can be made available by a program delivery system 46. The inference system 38 
scores active user viewing for every title stored in the database 32. 

In a training mode, the inference system 38 utilizes selections of previously 
viewed programs that are logged in a user's database 32 and selections of previously 

30 viewed programs that are logged in databases 36 of other shared systems. It is to be 

appreciated that the database information may be stored locally at the system 30, remotely 

11 
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at a remote server or the like (e.g., in a single database) or across a number of servers. 
Additionally, the inference system 38 may reside locally at the system 30, remotely at a 
remote server or across a number of servers. The inference system 38 is trained by 
examining selection reviewed by a large pool of users for more than a threshold amount 
5 of time. Negative votes are also considered by monitoring selections jumped away from 

after being reviewed briefly. In real-time, appropriate information or evidence about a 
user's preferences is inputted into the inference system 38. Evidences of preferences 
include information about previously selected programs from the database 32, other 
attributes of the shared system 34 and explicit input of samples of preferred items by the 

10 user through a user interface 42. Evidence of the users preference is largely gathered by 
implicit evidence of items that are liked or disliked by monitoring the user's activity. 
Temporal filtering can then be employed to provide a reviewed item list and a 
recommendation list for a particular time segment. 

Furthermore, a user via the user interface 42 may select an item for a positive or 

15 negative vote. For example, in a first iteration a user may be presented with a list of 

reviewed items for a selected time period. A user may then select amongst a variety of 
filtering components residing in a filtering system 40. Additionally, the user may select 
or provide positive or negative votes for items. The modified or filtered reviewed item 
list may then be inputted into the inference system 38 as further evidence of user 

20 preferences. 

The inference system 38 can then provide a recommendation list of programs 
ranked by preference values to a local cache system 47. The local cache system 47 then 
stores or records items that have the highest values. Items can be assigned higher values 
based on the likelihood that a user would like to view that particular program. 

25 Furthermore, values of programs can be aged out based on a cache retention policy. Such 

policies can be sensitive to the class of content cached. For example, the value of news 
broadcasts may decay more quickly with the age of the content, in comparison to 
documentary material covering a topic area that a user has conveyed an interest. In one 
aspect of the invention, a utility-directed knapsack analysis is continuously performed to 

30 store newly available content into available memory, based on the consideration of the 

"expected value density" of the content, which is defined as the ratio of the value 

12 
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assigned to some media content and the memory cost of storing the content based on the 
size of the content. 

The output provided to the user at a user interface 42 is a personalized program 
guide for upcoming broadcasted media (e,g., a view of the content in the next hour or 
5 next several hours that is sorted by inferred user preferences). The user interface 42 

allows a user to select the most desirable shows for later automated caching of content or 
give the system a go ahead for automated policies for downloading future television 
content that seek to maximize the value of a local cache system 47. Additionally, the 
filtering system 40 is provided with various filters, such that the reviewed items list may 

10 be reduced or re-ranked based on a user's input at the user interface 42. 

The recommendation list is also provided to the local cache system 47 residing in 
a program delivery system 46. The local cache system 47 utilizes the recommendation 
list to determine programs to store to the local cache system 47 that a user of the system is 
most likely interested in viewing. The programs are delivered fi*om a remote program 

1 5 source system 45, which also provides the inference system 38 with electronic program 

guide data 48. Alternatively, the inference system 38 can be directly linked to the local 
cache system 47 to provide the local cache system 47 with inferences of selectable 
programs that would be preferred by a system user based on previously viewed 
information by user's of the system 30 during a time interval of the time period being 

20 stored. 

The user interface 42 allows a user the ability to select a program for viewing 
and/or recording. Once a selection of a title to view is made by a user via the user 
interface 42, a request is transmitted to the program delivery system 46 by the filtering 
system 30. The program delivery system 46 transmits the requested program 

25 corresponding to the selected title to a viewer 44. Information about the viewed program 

is then transmitted back to the previously viewed programs database 32 for logging and 
for providing the viewed information to the inference system 38 for further training of the 
inference system 38. A system user may also select programs to be recorded via the user 
interface component 42 to the local cache system 47, which is then recorded for later 

30 viewing or for viewing when data is viewed at a faster rate than it can be transmitted fi*om 

the remote program source system 45. 

13 



Fig. 3 illustrates a block schematic diagram of a local cache system 50 in 
accordance with one aspect of the present invention. The local cache system 50 includes 
a cache loading system 52 operable to receive inferences from an inferences system 51, 
such as recommendation ranked by preference value, and/or direct instructions to record 
specific program titles from a filtering system 55 via the user interface 53. Once the 
cache loading system 52 receives inferences and/or instructions for recording program 
selections, the cache loading system 52 requests program information from the remote 
program source system 57 and stores this information in a memory system 58 employing 
a utility system 54. The memory system 58 can be a hard drive residing on a television 
set top box, a faster memory (e.g., a RAM) or a combination of a hard drive which 
transfers information to a faster memory when a program is selected. 

The utility system 54 employs a cache retention policy component 56 for aging 
out selection over time. A value assigned to a selection dynamically changes according to 
a set of cache retention policies. For example, a selection's value may be reduced as the 
selection ages because a user is less likely to view the selection over time. Additionally, 
the value of a selection changes based on changes on a user's viewing habits, changes in 
time segments or a user's modification of the predefined rules or policies. Such policies 
can be sensifive to the class of content cached. In one aspect of the invention, the utility 
system 54 continuously performs a utility-directed knapsack analysis to store newly 
available content into available memory, based on the consideration of the "expected 
value density" of the content, which is defined as the ratio of the value assigned to some 
media content and the memory cost of storing the content based on the size of the content. 

The memory system 58 includes a first portion or user define cache portion 60, a 
second portion or live show selections portion 62 and a third portion or general selections 
portion 64. The user defined cache portion 60 stores user selected programs for 
recording. The live show selections portion 62 contains stored information relating to 
programs that are currently in process that a user may want to catch from the beginning 
based on previous viewing habits with the current time interval. The general selections 
portion 64 is the portion of memory where general programs are recorded based on the 
likelihood that a system user would like to watch these programs. The general programs 

14 
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are recommended by the inference system 5 1 to record for later viewing of a system user 
based on previous viewing habits within the current time interval. The user defined cache 
portion 60 includes selections SI -S3, the live show selections portion 62 includes 
selections S4-S7 and the general selections portion 64 contains selections S8-S16. The 
5 selections S 1 -S 1 6 include programs of various time periods and sizes. 

The cache loading system 52 employs a bin packing methodology to store inferred 
program selection information in the memory system 58. The bin packing methodology 
of the present invention determines a sorting value of the selection by taking the inferred 
value of the selection divided by the size of the selection. The bin packing methodology 

10 then sorts the program selections in the general selections portion 64 of the memory 

system 58 from the highest sorting value to the lowest sorting value. The bin packing 
methodology (hereinafter referred to as "the value density method for bin packing") ranks 
program information based on the probability a user will most likely want to view a 
program at a specified time period within a time interval for which the inference system 

15 51 was trained. 

The local cache system 50 includes the utility system 54, which monitors the 
memory system 58 through information stored in the cache loading system 52. The utility 
system 54 monitors the program selection information residing in the memory system 58 
and utilizes the cache retention policy to age out the program selection information 

20 residing in the memory system 58. For example, the utility system 54 receives program 

loading information fi"om the cache loading system 52 including initial value and size 
information. The utility system 54 keeps track of the selections and value density 
programs in the memory system 58 and then periodically reassigns values to the program 
selections using the cache retention policy component 56. The utility system 54 then 

25 transfers this information to the cache loading system 52 which then rearranges the 

programs in the memory system 58 based on the new values. The cache retention policy 
component 56 can include different cache retention policies for different classes of 
programs. For example, news programs and live show programs can be aged out more 
rapidly than documentaries or movies. Additionally, new program selection information 

30 is periodically received by the cache loading system 52, which also becomes part of the 

program selection set of the programs already stored in the memory system 58. 
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In one aspect of the invention, the available memory in the general selections 
portion 64 becomes totally committed. In this event, newly available content overwrites 
previously stored content when the expected value density of the new content exceeds the 
expected value density of older content. As a programs value is reduced, it eventually 
5 becomes aged out by new programs with higher values since there is only a fixed amount 

of memory available. For example, after a program has resided in memory for a few 
days, it is highly unlikely that a system user will watch this program. Therefore, the value 
of the program is reduced based on the cache retention policies residing in the cache 
retention policy component 56. It is to be appreciated that the cache retention policy 

1 0 component 56 may be customized for the system or programmable by a user via the user 
interface 53. Alternatively, the cache retention policies residing in the cache retention 
policy component 56 may be based on a value density aging model. The cache retention 
policies residing in the cache retention policy component 56 may be based on a separate 
model utilizing historical information of viewing habits of recorded information in 

1 5 general or over specific time intervals. As selections reach the end of the general 

selection memory portion 64 or progress in age, the information can be compressed, so 
that more information can be stored in the general memory portion 64. In other words, 
the size and the quality of the item recorded is reduced, based on the reduced likelihood 
that the user will watch a show so that the item can still be retained for as long as 

20 possible. 

Fig. 4 illustrates a block schematic diagram of a local cache system 70 in 
accordance with another aspect of the present invention. The local cache system 70 
includes a cache loading system 72 operable to receive inferences fi-om an inferences 
system 71, such as recommendation ranked by preference value, and/or direct instructions 

25 to record specific program titles fi-om a filtering system 75 via a user interface 73. Once 

the cache loading system 72 receives inferences and/or instructions for recording program 
selections, the cache loading system 72 requests program information fi"om the remote 
program source system 77 and stores this information in a memory system 76 employing 
a time dependent utility model 74. The memory system 76 can be a hard drive residing 

30 on a television set top box, a faster memory {e,g,, a RAM) or a combination of a hard 

drive which transfers information to a faster memory when a program is selected. 
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Based on the time dependent utility model 74, the expected utility of maintaining 
content in the memory system 76 can be deteraiined by the ratio of the current utility as a 
function of the age of the item and the policy that is active for the particular item. The 
value of content stored in the memory system 76 decays based on the class or type of 
5 content, in accordance with the time-dependent utility model 14, for example, utility 

becomes a function of initial utility, age and content class. Thus, the expected value 
density of content stored in the memory system 76 is the ratio of the size of the object and 
the current utility of the object as determined by the time-dependent utility model 74. 

The memory system 76 includes a first portion or user define cache portion 80, a 

10 second portion or live show selections portion 82 and a third portion or general selections 

portion 84. The user defined cache portion 80 stores user selected programs for 
recording. The live show selections portion 82 contains stored information relating to 
programs that are currently in process that a user may want to catch from the beginning 
based on previous viewing habits with the current time interval. The general selections 

1 5 portion 84 is the portion of memory where general programs are recorded based on the 

likelihood that a system user would like to watch these programs. The general programs 
are recommended by the inference system 71 to record for later viewing of a system user 
based on previous viewing habits within the current time interval. The user defined cache 
portion 80 includes selections SI -S3, the live show selections portion 82 includes 

20 selections S4-S7 and the general selections portion 84 contains selections S8-S16. The 

selections SI -SI 6 include programs of various time periods and sizes. 

The local cache system 70 includes the time dependent utility model 74, which 
monitors the memory system 76 through information stored in the cache loading system 
72. The time dependent utility model 74 monitors the program selecfibn information 

25 residing in the memory system 76 and utilizes the expected value density of new and old 

content to age out the program selection information residing in the memory system 76. 
For example, the time dependent utility model 74 receives program loading information 
from the cache loading system 72 and keeps track of the selections and the expected value 
density of programs in the memory system 76. The time dependent utility model 74 

30 periodically reassigns values to the program selections. The time dependent utility model 

74 then transfers this information to the cache loading system 72 which then rearranges 

17 



•MS 150903.1 




the programs in the memory system 76 based on the new values. The time dependent 
utility model 74 can include different policies for different classes of programs. 
Furthermore, the initial default time-dependent decay functions for each class can be 
continuously refined by observing and logging the likelihood that a user will observe a 
5 recorded show with the amount of time that has passed since the recording has been made 

and the show has not yet been watched. 

In one aspect of the invention, the available memory in the general selections 
portion 84 becomes totally committed. In this event, newly available content overwrites 
previously stored content when the expected value density of the new content exceeds the 

10 expected value density of older content. As a programs value is reduced, it eventually 

becomes aged out by new programs with higher values. For example, after a program has 
resided in memory for a few days, it is highly unlikely that a system user will watch this 
program. Therefore, the value of the program is reduced based on the time dependent 
utility model 74. As selections reach the end of the general selection memory portion 84 

1 5 or progress in age, the information can be compressed, so that more information can be 

stored in the general memory portion 84. The size and the quality of the item recorded 
can be reduced, based on the reduced likelihood that the user will watch a show so that 
the item can still be retained for as long as possible. 

Fig. 5 illustrates a block schematic diagram of additional components of the 

20 multimedia system 90 employed to provide live show selections to a system user, so that 

the user may catch shows already in progress. A local cache 97 residing in a program 
delivery system 96 is provided with N number of tuners 102 coupled to a live show 
selections portion 100 of a memory system 98. An inference system 92, directly or 
through a filtering system 94 via a user interface 93, provides the program delivery 

25 system 96 with prediction information on which programs that a system user will most 

likely be interested in viewing at any given time period. A cache loading system 1 04 
within the local cache system 97 will begin recording these programs from the beginning 
of the show. Once a user selects a program through the user interface 93, the filtering 
system 94 transmits a request to the program delivery system 96. The program delivery 

30 system 96 then begins transmitting the program from the live selections portion 1 00 of 

the memory system 98 to a viewer 95. The remaining portion of the program is recorded 
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from a remote program source 108 as the beginning portions are transmitted to the viewer 
95, so that the user may view the entire program from the beginning to the end. Other 
programs in the live show selections portion 100 can be removed from the memory 
system 98 or overwritten once a selection has been made. 
5 At the end of a programming time period, new programs are recorded and old 

programs are abandoned or eventually aged out based on a cache retention policy 106. 
The selections for the live show selection portion 100 can be provided with a very high 
value during the period of time that the show is actually live and be quickly aged out after 
the show ends. Therefore, new live show selections are constantly replacing old live 

10 show selections. It is to be appreciated that the live show selection portion and the 

general selection portion of the memory system 98 can be replaced by a general memory 
portion employing a quick aging out methodology of live show selections. For example, 
live show selections can be provided with a very high value in the general memory 
portion and quickly aged out after the show ends. In this way, a single general memory 

1 5 portion may be employed for storing all program information. 

In one aspect of the invention, live shows are specially treated such that shows 
starting at standard times {e.g., on the hour, on the half hour) for multiple shows (per 
multiple tuners, ranked by likelihood that a user will watch the show) are recorded, and 
the value of these shows are atypically high at the hour or half hour (e.g., standard starting 

20 times) that the show is running. Additionally, the live shows are decayed out more 

quickly given that the shows are being treated specially for the purpose of providing a 
service of "near real time" watching. That is for when users begin viewing, briefly after a 
show is already in progress. 

Fig. 6 illustrates an example of a possible user interface 1 1 0 that allows a user to 

25 review available selections quickly without unduly searching, for example, via a remote 

control. A day scroll down menu 1 12 and a time scroll down menu 1 14 are provided to 
allow a user to select a start time for providing recommendations of program selections to 
the user. A period scroll down menu 1 16 is also provided that allows a user to select a 
time period for providing suggested program selections. The period scroll down menu 

30 116 illustrates a few possible selections that a user can select, such as "now" (e.g., live 

selections) ,"anytime", or "next two hours". Other selections may be provided, such as 
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"next 1 2 hours", "next day", "next week", "2 hours from now", etc. Once a user has 
selected a date and time to start from and a time period, the user can then select an 
"Update" button 128. A plurality of recommendations are then provided to the user in a 
recommendation window 126. The selections fall within the time period requested, and 
5 are ranked according to selections that the user is most likely to be interested in viewing 

and/or recording {e.g., inferred strength) based on employing inference techniques on 
historical data for a time interval encompassing the requested time period. 

A second window 124 is provided that includes a reviewed items list. The 
reviewed items list includes a plurality of items that have been reviewed by users of the 

10 system. Items that the user has reviewed for a threshold period of time within a time 

period selected are assigned a positive vote as indicated by a check mark in a box located 
in a positive vote column. Items that the user has jumped away from after being reviewed 
briefly within a time period selected are assigned a negative vote as indicated by a check 
mark in a box located in a negative vote column. The reviewed items list is inputted into 

1 5 the inference system to provide the recommended items in the window 1 26. The 

reviewed items list is editable such that the user can edit or assign positive and negative 
votes to an item and select the "Update" button 128 to modify the recommended items of 
interest in the window 126. 

A population selection box 1 18 is provided to allow a user to disable/enable a 

20 popularity filter. The popularity filter evaluates selections that are likely to be of interest 

to a user that the user is most likely not to know about. For example, a selection can be 
assigned a value by multipljdng an inference value by the probability that the user did not 
know about the selection. If the population selection box is selected, a plurality of 
selections that a user does not know about, but may find of interest, is provided in 

25 recommendations window 126. Another window 129 provides other suggested links of 

interest, for example, that are downloadable for viewing. Additionally, a first search 
window 120 is provided for allowing a user to enter patterns for updating the evidence • 
about the kind of show that the user is interested in reviewing. A second search window 
122 is provided for displaying the results of the pattern search. A user can scan through 

30 the recommendations using a remote control or the like and choose to record the selecfion 

by choosing a "Record" button 1 25 or choose to view the selection by choosing a "View" 

20 



•MS 150903.1 



button 127. 

It is to be appreciated that some multimedia programs are broadcast periodically 
that are not live or are available via a request or a link. For these types of broadcasts the 
present invention is adapted to allow real-time viewing of the content by storing a portion 
5 of the program in local memory that is necessary for viewing of the content in its entirety 

without interruption due to viewing that occurs faster than the downloading of the 
content. The present invention employs methodologies that determine the needs to be 
downloaded, so as to allow time for the complement to be downloaded should the system 
sense the user is reviewing an entire program. 

10 Fig. 7 illustrates a program delivery system 142 that resides on a server 140 

coupled to a set top box 150 of a client via a communication link 148. The 
communication link 148 can be via a hardwire link (e.g., a communication cable) or a 
wireless link {e.g., a satellite link). The program delivery system 142 includes an 
inference system 144 that receives general media selections 145 and other media 

1 5 selections 146 that are broadcast periodically or available by request {e.g., pay for 

viewing). The inference system 144 reviews specific viewing history of users of the set 
top box 150, and transmits system specific recommendations to the set top box 150. 
Additional system specific inference systems can be provided for each system coupled to 
the server 140. The set top box 150 includes an electronic programming guide system 

20 151 comprised of a user interface component 1 52 coupled to a filtering system 1 54. 

The set top box 1 50 also includes a secondary storage system 1 56 for storing 
portions of selections from the non-live media selection {e.g., via a link or a request) most 
likely to be of interest to a system user. The server 140 and the program delivery system 
142 are operable to understand both the electronic programming guide system 151 and 

25 individual subscriber viewing habits based on selection made at the set top box 150. 

These selections can be determined by requests made at the set top box 1 50 or 
alternatively by transmitting information from the set top box 150 back to the server 140. 
This information is logged and used to train an inference system 144. The program 
delivery system 140 provides the recommendations to the set top box 150 on what 

30 selections to log in the secondary storage system 156 based on inferences determined by 

the inference system 144. The recommendations are determined utilizing previous 
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viewing habits of users and the available selections from the general media selections 145 
and the other media selection 146. 

Fig. 8 illustrates a block schematic diagram of the secondary storage system 166 
in accordance with one aspect of the present invention. The secondary storage system 
5 166 includes a memory loading system 168 operable to receive inferences directly from 

an inference system 160 and/or direct instructions to record specific program titles from a 
filtering system 162 via a user interface 161. Once the memory loading system 168 
receives inferences and/or instructions for recording program selections, the memory 
loading system 168 requests program information from a remote program source system 

10 164 and stores this information in a secondary memory 172. The second memory 172 can 

be a hard drive residing on a television set top box, a faster memory {e.g., a RAM) or a 
combinafion of a hard drive which transfers information to a faster memory when a 
program is selected. The secondary storage system 166 stores portions of broadcasted 
programs that a user will most likely want to view at a specified time period within a time 

1 5 interval for which the inference system was trained. The memory loading system 168 

determines the portion of the program to store based on the transfer rate of the program 
from the remote program source system 1 64 and the viewing rate of a viewing system 
1 69. The portion of the program is then stored in the secondary memory 1 72. In the 
present example, 60% of program A, 20% of program B and 50% of program C are stored 

20 in the secondary memory 1 72. 

A utility system 170 is coupled to the memory loading system 168. The utility 
system 170 employs a cache retention policy component 171 for aging out selection over 
time. A value assigned to a selection dynamically changes according to a set of cache 
retention policies. For example, a selection's value may be reduced as the selection ages 

25 because a user is less likely to view the selection over time. Additionally, the value of a 

selection changes based on changes on a user's viewing habits, changes in time segments 
or a user's modification of the predefined rules or policies. For example, if programs 
have not been viewed for a period of time, the value of the program is reduced and 
eventually aged out as new programs of higher value are loaded into the secondary 

30 memory 1 72. Once a user selects a program through the user interface 161, the program 

is transmitted from secondary memory 172 to the viewing system 169. The remaining 
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portion of the program is downloaded from the remote program source 164 as the 
beginning portions are transmitted to the viewer 1 69, so that the user may view the entire 
program from the beginning to the end without interruptions. Other programs in the 
secondary storage 172 can be removed from the memory or overwritten once a selection 
5 has been made. 

In view of the foregoing structural and functional features described above, 
methodologies in accordance with various aspects of the present invention will be better 
appreciated with reference to Figs. 9-11. While, for purposes of simplicity of 
explanation, the methodology of Figs. 9-11 is shown and described as executing serially, 

10 it is to be understood and appreciated that the present invention is not limited by the 

illustrated order, as some aspects could, in accordance with the present invention, occur 
in different orders and/or concurrently with other aspects from that shown and described 
herein. Moreover, not all illustrated features may be required to implement a 
methodology in accordance with an aspect the present invention. It is further to be 

1 5 appreciated that the following methodology may be implemented as computer-executable 

instructions, such as software stored in a computer-readable medium. Alternatively, the 
methodology may be implemented as hardware or a combination of hardware and 
software. 

Fig. 9 illustrates one particular methodology for providing a recommendation set 
20 to a local storage system employing an inference engine in accordance with one aspect of 

the present invention. At 200, information retrieved by the system is monitored. At 210, 
retrieved information titles are time stamped and logged. The retrieved information titles 
are then assigned a value based on the number of times the title has been retrieved 
utilizing inference techniques. At 220, all available information titles for a future time 
25 interval are retrieved. At 230, all available titles based on a time period and on previously 

reviewed information for a time interval covering the time period are assigned values and 
ranked. At 240, the selected titles are provided in ranked order for the time period 
requested. The ranked titles are then transmitted to a local cache system for loading of 
the ranked titles in local memory. 
30 Fig. 1 0 illustrates one particular methodology for storing information in a local 

cache utilizing the value density bin packing method and a cache retention policy in 
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accordance with one aspect of the present invention. At 260, a sorting value is 
determined for each title by determining the probability that a system user would like to 
view the information divided by the size of the information. At 270, titles are stored in 
the local cache from the highest sorting value to the lowest sorting value until the local 
5 cache is full. At 280, the methodology determines if any new titles have been received. 

If any new titles have not been received (NO), the method proceeds to 290. At 290, the 
sorting values of the titles are dynamically adjusted based on a set cache retention 
policies. The information is then rearranged in the local cache based on the adjusted 
sorting values of the titles at 300. The method then returns to 280 for repeating the step 

1 0 of determining if any new titles have been received. If any new titles have been received 
(YES) at 280, the method proceeds to 3 10. At 310, the sorting values of the new titles are 
determined based on the probability that a system user would like to view the information 
divided by the size of the information for each title. At 320, the new and old titles are 
stored in the cache from the highest sorting value to the lowest sorting value while titles 

1 5 of the lowest values are aged out of the cache. The method then returns to 280 for 

repeating the step of determining if any new titles have been received. 

Fig. 1 1 illustrates one particular methodology for providing real time viewing of 
programs that are not live and are broadcasted periodically from a source to a multimedia 
system in accordance with one aspect of the present invention. At 340, other multimedia 

20 programs that are not broadcasted live that are likely to be interesting to a system user are 
determined. At 350, a viewing rate and a transmission rate of each program is determined 
for N programs. A percentage of each of the N programs is stored in a local cache 
necessary to ensure uninterrupted viewing of a selected program, at 360. At 370, the 
method determines if a program has been selected. If a program has not been selected 

25 (NO), the programs in the local cache are aged out based on a set of cache retention 

policies at 375. Once a program is selected (YES), the method advances to 380. At 380, 
the contents of the selected program are downloaded from the cache to the viewer. At 
390, the remaining portion of the selected program is downloaded to the cache as the 
program is viewed, until a complete download of the program has occurred. 

30 With reference to Fig. 1 2, an exemplary system for implementing a portion of the 

invention includes a conventional personal or server computer 420, including a 
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processing unit 42 1 , a system memory 422, and a system bus 423 that couples various 
system components including the system memory to the processing unit 421 . The 
processing unit may be any of various commercially available processors, including Intel 
x86, Pentium and compatible microprocessors from Intel and others, including Cyrix, 
5 AMD and Nexgen; Alpha from Digital; MIPS from MIPS Technology, NEC, IDT, 

Siemens, and others; and the PowerPC from IBM and Motorola. Dual microprocessors 
and other multi-processor architectures also can be used as the processing unit 42 1 . 

The system bus may be any of several types of bus structure including a memory 
bus or memory controller, a peripheral bus, and a local bus using any of a variety of 

10 conventional bus architectures such as PCI, VESA, MicroChannel, ISA and EISA, to 
name a few. The system memory includes read only memory (ROM) 424 and random 
access memory (RAM) 425. A basic input/output system (BIOS), containing the basic 
routines that help to transfer information between elements within the computer 420, such 
as during start-up, is stored in ROM 424. 

1 5 The computer 420 ftirther includes a hard disk drive 427, a magnetic disk drive 

428, e,g., to read from or write to a removable disk 429, and an optical disk drive 430, 
e.g., for reading a CD-ROM disk 43 1 or to read from or write to other optical media. The 
hard disk drive 427, magnetic disk drive 428, and optical disk drive 430 are connected to 
the system bus 423 by a hard disk drive interface 432, a magnetic disk drive interface 

20 433, and an optical drive interface 434, respectively. The drives and their associated 

computer-readable media provide nonvolatile storage of data, data structures, computer- 
executable instructions, etc. for the server computer 420. Although the description of 
computer-readable media above refers to a hard disk, a removable magnetic disk and a 
CD, it should be appreciated by those skilled in the art that other types of media which are 

25 readable by a computer, such as magnetic cassettes, flash memory cards, digital video 

disks, Bernoulli cartridges, and the like, may also be used in the exemplary operating 
environment. A number of program modules may be stored in the drives and RAM 425, 
including an operating system 435, one or more application programs 436, other program 
modules 437, and program data 438. 

30 A user may enter commands and information into the computer 420 through a 

keyboard 440 and pointing device, such as a mouse 442. Other input devices (not shown) 
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may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These 
and other input devices are often connected to the processing unit 421 through a serial 
port interface 446 that is coupled to the system bus, but may be connected by other 
interfaces, such as a parallel port, game port or a universal serial bus (USB). A monitor 
5 447 or other type of display device is also connected to the system bus 423 via an 

interface, such as a video adapter 448. In addition to the monitor, computers typically 
include other peripheral output devices (not shown), such as speakers and printers. 

The computer 420 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote server or client computer 

1 0 449. The remote computer 449 may be a workstation, a server computer, a router, a peer 

device or other common network node, and typically includes many or all of the elements 
described relative to the computer 420, although only a memory storage device 450 has 
been illustrated in Fig. 12. The logical connections depicted in Fig. 12 include a local 
area network (LAN) 451 and a wide area network (WAN) 452. Such networking 

15 environments are commonplace in offices, enterprise-wide computer networks, intranets 

and the Internet. 

When used in a LAN networking environment, the computer 420 is connected to 
the local network 451 through a network interface or adapter 453. When used in a WAN 
networking environment, the server computer 420 typically includes a modem 454, or is 

20 connected to a communications server on the LAN, or has other means for establishing 

communications over the wide area network 452, such as the Internet. The modem 454, 
which may be internal or external, is connected to the system bus 423 via the serial port 
interface 446. In a networked environment, program modules depicted relative to the 
computer 420, or portions thereof, may be stored in the remote memory storage device. It 

25 will be appreciated that the network connections shown are exemplary and other means of 

establishing a communications link between the computers may be used. 

In accordance with practices of persons skilled in the art of computer 
programming, the present invention is described below with reference to acts and 
symbolic representations of operations that are performed by the computer 420, unless 

30 indicated otherwise. Such acts and operations are sometimes referred to as being 

computer-executed. It will be appreciated that the acts and symbolically represented 

26 



•MS 150903.1 




operations include the manipulation by the processing unit 421 of electrical signals 
representing data bits which causes a resulting transformation or reduction of the 
electrical signal representation, and the maintenance of data bits at memory locations in 
the memory system (including the system memory 422, hard drive 427, floppy disks 429, 

5 and CD-ROM 43 1 ) to thereby reconfigure or otherwise alter the computer system's 

operation, as well as other processing of signals. The memory locations where data bits 
are maintained are physical locations that have particular electrical, magnetic, or optical 
properties corresponding to the data bits. 

The invention has been described with reference to the preferred aspects of the 

10 invention. Obviously, modifications and alterations will occur to others upon reading and 
understanding the foregone detailed description. It is intended that the invention be 
construed as including all such modifications alterations, and equivalents thereof. 
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